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ABSTRACT 
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for determining the the 100(1-aj% lower confidence 
limit for the reliability of a system composed of a 
mixture of series and parallel connected components 
for which only component level test data is available. 
The method is an extension of the Log-gamma procedure 
originally proposed for series connected systems only. 
The accuracy of the method is assessed for some 
representative system reliability constructs using a 
computer Simulation procedure. The Simulation results 
are examined with a view toward identification of 
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I. INTRODUCTION 


Often, in the design and production of complex systems, 
an important question to be answered early in the process 
concerns the demonstrable system reliability based upon 
observed mission test results. Usually only components and 
minor subassemblies can be tested in any but the very latest 
Stages of production. For reasons of prototyp2 cost, the 
lack of complete systems for early tests, the expense 
involved in total system operational tests, and the need to 
make production decisions as early as feasible, reliance 
must be shifted to the component test results to provide at 
least an approximate answer to this question. Component 
data must be used in spite of the moderately strong 
assumptions needed to transform such test resultS into an 


estimate of overall systen reliability. 


Since estimates are, by their nature, inexact, it would 
be reasonable to expect that the most credible estimate 
would be one which was both conservative and carried with it 
an indicator of the degree of conservatism associated with 
its computation. This, of course, is a description fitting 
a lower confidence limit when referring to estimates of 
System reliability. Thus, when one speaks of a "100 (1-a)% 
lower confidence limit" and obtains a value for it, the 
assertion is that the obtained lower confidence limit value 
is less than the actual system reliability with probability 


T-a. 


In 1968, J. R. Borsting and W. M. Woods developed what 
is known as the Log-Gamma method for computing lower 


confidence linits Bo is system reliability based upon 





component mission test results only [{[Ref. 1]. AS originally 
developed, the Log=Gamma method was restricted to systems 
composed of all series connected components. It did, 
however, offer the advantage of allowing for unequal sample 
sizes, so the number of component tests could vary 
arbitrarily from component to component without degrading 
the procedure accuracy. In addition, no assumption is 


needed concerning the failure distribution of any component. 


Woods has recently proposed a modification to the 
procedure which, it was hoped, would extend its application 
to a mixed system of series and parallel connected 
components, The purpose of this study is to assess the 
accuracy of the revised procedure when applied to some 
typical component failure data from several representative 
series and series-parallel systems. An attempt is also made 
to discern parameters (constructed from or inherent to the 
sample data, component reliability goals, testing plan, and 
system design) which could provide useful indicators of the 


expected accuracy of the procedure. 





It should be noted that two rather strong assumptions 
need to be made with respect to system and component 
reliabilities. First, it must be assumed that component 
tests were conducted in a test environment not unlike that 
encountered in the system operational mission environment 
profile. Second, no component reliability degradation will 
result from interactions with other components when 
assembled into the system. The degree to which these two 
assumptions are met will have an unknown but potentially 
great effect upon the validity of the model and indeed upon 
the whole concept of system reliability prediction fron 


component attributes data. 
A. DEVELOPMENT FOR SERIES SYSTEMS 


This section gives a nodified and elaborated development 
of the basic reliability model and estimation procedure 


based upon that presented by Woods and Borsting [Ref. 1]. 

For a system of k components in logical series, the 
system reliability, Rs, can be expressed in terms of the 
individual component reliabilities as the product 


K e 
Rs = lI Pi (2.1) 


where Pi is the true reliability of the i-th component. 


From Pi the component unreliability, Q1, 1s defined as 








One = ali 1 


Taking the natural logarithm in equation (2.1) and 


defining the new variable, 3s: 


The 


k 
S = -lnRs = een) es) (Za) 
’ L= 
natural logarithm can be expanded by the infinite series 


in (=k): = -EN/3 for 0<X<1 
See 


‘Ef (u/s (2.3) 
21=1 j=1 


op) 
i" 


k 
setae # Q12/2 + 01373 + ...} 
i= 


For Qi small, say 0.1 or less, the above series may be 


approximated by the first two terms with a maximum error of 
0.34% of the true value. Thus, 


a 


k 
Se-  f [Ql + Ole72)} = 2 re (2.4) 
i=1 i= 


where Ti = Q2 + Q127/2. For the remainder of the 


derivation this approximation is treated as an equality. 


Appendix A derives an unbiased estimator, Ti, for Ti: 


Ti = AiO + Bildi2]/2 (2.5) 
where Ai = [{ 2Ni-3 ]/[ 2Ni-2] 

Bi = Ni/[Ni-1] 

Qi = Fi/Ni 


Fi is the number of failures resulting from Ni 


mission tests conducted on the i-th component. 


An unbiased estimator of S will be obtained from 
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k A e 
Ss = = T1 (20) 


§ will be an unbiased estimator of S, since it is the sum of 


the unbiased estimators, Ti, Ofwl 1. 


Appendix B shows that, for the reasonably expected range 


of values for Qi and Ni, the variance of S may be 


approximated 


A k - k 
Var[{S] = ee ae = ete (257) 
L= 1L= 


By intuitively assuming the probability distribution of 
S is of the gamma type with parameters r and 96, an 


expression can be derived for a confidence interval for Rs. 


The gamma probability density may be written as 


1 r- 1 ~-x/9 
aan | Q) . : >0 (2.8) 
Pexe, Ic = = yee i 
cae l(z)"@ 
0 x<0 
with mean = r9 and variance = r62, 


To determine the values of cr and 6, the following 


relationships are established: 


E[S] = r8 from Eg. (2.8) 
P k 
cho) = oe PMN eek IHefee (AG), 
L= 
Var[$] = ree from Eq. (2.8) 
f F en 2 
ar = , eee 
Ls] i1=1 Ni 


These equations may be solved simultaneously to yield the 
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following expressions for r and @: 


NS es) | ie 
_% Ti =o — 
i=1 1=1 Ni 
c>--_ and Q9=-—- 
Kena Ke. 
t.— Pe iaeet ba 
1=1 Ni i-1 


and an estimator, r, for r would be 


.! i]? 
Ry phak 
i=1 


k Ti 


a : 
1=1 Ni 


rf > 
Ul 


(Ze) 


Note that for § distributed as gamma(r,9), 25/8 will be 
distributed as chi-square with 2r degrees of freedom [ Ref. 


2, Pe 181]. The following probability statements can then 


be made: 
2s 2 
I-an = PH— 2 (2.10) 
9 2E, 1-2 
2s 
1-a = at < 
2 
X2r, 1-2 
Since 9 = E{S]/r from Eq. (2.8) and E[S ] = -inRks fron” 
cee (oe 2) » 





-inks 2S 
l-a = P See 
re 2 
Yor, 1a 
-2rs 
a 2| rns , | 


2 
Xor, 1-0 


Thus the 100(1-q)% lower confidence limit, Rs*€a), for Rs 
is 
-2rs 
Rs*€) = exp -————— (2.11) 


Z 
26 oe 
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A 100(1-a )% lower confidence limit estimate, Rs*€%, for Rs 
would be 


: -2rs 
Rok C= exp -—— (212) 


Ze 
Xie 


The primary difficulty this formulation presents lies in 
the non-integer nature of values for 2r as defined. 
Although some computer routines are available to approximate 
chi-square values with non-integer degrees of freedom, most 
users would find such a requirement difficult to fulfill at 
least. Therefore 2r is replaced with the expression 

[2r] = smallest integer > 2r 
This 1s justified by noting that the ratio of the chi-square 
value divided by its number of degrees of freedom varies 
Slowly with changes in the degrees of freedom for values of 
degrees of freedom greater than about five. Further, since 
2c may be changed moderately, by up to 1.0, without great 


change in the ratio value, it is reasonable to expect that 


F 2 
the probability distribution of [{2r Fe has small 
L202 jy leet: 
variance. This expression can be subsittuted into equation 


(2.12) to yield 


Rs*€a) = exp 75 ; (225135) 
Mf2t 11-4 


Since the computer routines available for this research 
included the capability of computation of chi-square values 
With non-integer degrees of freedom, some Simulation runs 
were performed uSing both equations (2.12) and (2.13) for 
comparison. The results indicated that the effects were 
limited to the third decimal place at worst and thus had 


little significance with respect to the procedural accuracy. 


ie 





B. REVISION FOR SERIES-PARALLEL SYSTEM 


Proceding from the strictly series system procedure 
developed above, the principal revision for the mixed 


series-parallel system procedure was to redefine Ti and fr as 


follows: 
Sign _ Fie 
aA. Al— + Bl-——— 1= hypo eee 
Til = Ni 2N12 (2. 14) 
(1-Ri) + (1-Ri)2/2 4i=K1+1,...,K2 
K1+K2 . 12 
2 seal 
‘a 1=1 
Mig BS tia 1 = (25715) 
ee ji 
1=1 Ni 
2 Keren 2 ae 
ae. 2 at (2.16 
1=1 
where Al, Bi, Fi, and Ni are defined as before 


K1 is the number of series components 

K2 1S the number of series-parallel subassemblies 
interconnected in series 

Ri is the reliability point estimate for the i-th 
subassembly determined in the usual manner from the 
individual point estimates for the subassembly components as 


derived from the raw failure data. 


Although some comparison runs were made uSing Ai and Bi 
coefficients for the subassembly contribution to S, no 
Significant improvement in accuracy was noted and the use of 
these coefficients in this manner was abandoned due to the 
difficuity of computation with varying sample sizes within a 


Subassembly. 


14 








C. SPECIAL CIRCUMSTANCES 


In the event of no failures in any components or a _ lack 
of sufficient failures in subassembly components such that 
the basic procedure yields an § value of zero and, thus, a 
system reliability lower confidence limit estimate of one, 


an alternate approach must be employed. 


Statistically, the optimum solution might be to continue 
testing until sufficient component failures have been 
observed such that the above conditions no longer exist. 
However, such a solution might also not be economically 
feasible. Therefore, the sinulation included provision for 
an alternate procedure when S equals zero at the end of the 
programmed number of tests on all components. In addition, 
several cases were included where such conditions would be 
expected to exist in a Significant number of the simulation 
runs, in order to observe the efficacy of the alternate 


procedure. 


The derivation of this alternate procedure is given in 


Appendix C. The procedure may be summarized as follows: 


(i) Find the series component or subassembly with the 
Smallest actual oor equivalent number of trials, N or N°, 
respectively. (See section IV.B.1) 

(li) Change the aumber of component or subassembly 


failures to F' by the following scheme: 


F? 
On? 0.37 NOTE: Foc best results, N or 
0.1 O25 N' should be at least 10. 


015.05 0.16 
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If a subassembly was selected, treat the subassembly as a 
component with F* failures out of N' mission trials for the 
remainder of this procedure. 

(111) Recompute the lower confidence limit estimate 
using the basic log-gamma procedure with the revised failure 
data. This estimate 1s approximately equivalent to aq raised 


to the 1/N power as explained in Appendix C. 
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A. PROCEDURE 


\ 


The computer simulation program is listed in Appendix FP. 


The following procedure was incorporated into the program: 


‘Step One: Initialize and read in values for the total 
humber of components in series, Ki, the number of 
subassemblies in series, K2, the number of components within 
each subassembly, the number of tests performed upon each 
component, Ni, the true reliability of each component, Ri, 


and the seed value for the random number generator. 


Step Two: For each component in turn, generate the 
observed number of failures as a binomially distributed 


random variable, Fi, with parameters Ni and (1-Ri). 


Step Three: Compute Ti for each series component and 
subassembly, S from the sum of the Ti, and according to 


equations (2.14), (2.15), and (2.16) respectively. 


Step four: Compute the resulting estimate of the 
100(1-a)% lower confidence limit, R¥CA), aCeOrdingmste 
equation (2.13) for representative values of alpha and store 
each estimate in a vector array of estimates. Alpha values 
used in this study were 0.20, 0.10, and 0.05. 


Step Five: Repeat Steps Two through Four until the 


three vector arrays of estimates corresponding to the three 


17 





different alpha values are 1000 values in length. 


Step Six: Order the elements of each vector array from 
low to high and determine the sample mean and standard 


deviation. 


Step Seven: Compute the true system reliability, Rs, 
from the input component reliabilities. 


Step Eight: Extract the 100(1-a) percentile value from 
the corresponding array and compare with the true system 
reliability. If the estimation procedure is accurate these 
two values should agree. If agreement does not occur, the 
differences should be small, preferably conservative, and, 


hopefully, can be made to converge toward zero. 


Step Nine: Output all data which was input in Step One 
in order to insure against input error. Output starting and 
ending random number generator seed values. Output true 
system reliability, 100(1-%) percentile values, differences 
from true reliability, sample means and standard deviations, 
and various percentile values of interest. Provision is 
made in the program for output of all of the sample values 


both before and after ordering, if the user desires. 


Step Four was performed in two different ways for four 
of the cases where there was a high frequency of runs 
without failures, called ‘null runs in the output. The 
normal way of handling this problem was to discard that run 
data and repeat it from step one. Thus the complete arrays 
contained estimates from only those runs which had 
sufficient failures for the procedure to be valid without 
the special circumstances modification discussed in Section 
Tih aGe In order to observe the effect of utilizing the 
modification, however, cases 18 through 21 were repeated as 


cases 30 through 33 with the alternate procedure invoked 
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whenever § equalled zero at the end of step three. 


Three proprietary routines were utilized in the progran 
and are therefore not reproduced in the program listing. 
These routines were used to obtain the binomially 
distributed random variables, the chi-square function 


values, and to sort the estimate arrays [Ref. 4]. 


B. DESCRIPTION OF THE CASES 


The cases chosen for simulation represent three 
different configurations; a series of components connected 
in series with a series of simple series-parallel 
subassemblies of components, a strictly series-connected 
system of components, anda system which incorporates two 
somewhat unusual but representative "real-world" subassembly 
reliability relationships. The first configuration was 
chosen to demonstrate the general performance of the revised 
estimation procedure with a moderately complex, 
series-parallel system. The second configuration consisted 
primarily of some cases Which had previously been 
investigated for the original Log-gamma procedure [Ref. 1]. 
Since the revised procedure varied somewhat from the 
originally developed version in the treatment of the wholly 
series system, a comparison was desirable in order to 
ascertain whether significant effects had occurred in the 
procedure accuracy. The third configuration was chosen to 
observe the robustness of the procedure when applied to a 
Much more complex system which is not easily reducable to a 


Simpler series-parallel reliability representation. 


Ws 





In general, the simulated number of tests was the 
same for each component within each case. However, this 
number was varied among cases with the same true system 
reliability in order to identify its effect upon the 
procedure accuracy. The two exceptions were case 13 wherein 
the number of tests varied from component to component and 
case 14% for which only one value of simulated component 
tests was used without any corresponding cases with 


different numbers of tests. 


Ae 





b. Test Parameters 


(1) Number of Component Tests, Ni. 


i JS CS ae _Ni 
01, O04, O7, 10 20 1°=1,2,...,32 
02, 05.5 08, 11 50 = 172 ee 


Oe avon. \.ommel 1007S =e cote 
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-950. i=2 1 eee 
5995 \i=1, 2eeeeeo 
poi i=?) eres 
"990 0i= 12) eee 
‘oa i=? lees 


3995 1=1) Zee 
On 02, 03 e733), 


O07, 08, 09 Se) tes y/ 


s990 1 =1,-2,..25 20 
TO”, Te 12 S23 ey 
~900 12=21,.62, 32 


3. Case Thirteen 


——_— = aa ae ee 2S SS 


a. Reliability Block Diagranrm 





11 
=| OF RE 
13 
b. Test Paramet2rs 

pe ta olen pe Ne ee ee Ne ee 
1 150 .995 7 28 .967 13 59° Socz 
2 90 .985 8 125 .995 14 5 .729 
3 75 .979 9 63 970 15 Be st Zg 
ue 100 -988 10" 125 2995 16 5 ©2729 
5S 125 ©2962 11 59 .682 1, 19 .536 
6 18 .9890 12 539 2632 18 19 .536 
Rs: 0.72329 19 19° 2536 
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eG: Discussion 


This case corresponds to Case No. 1 of reference 
1. The only change was to replace the last three components 
each with three components in parallel with a subsysten 
reliability equivalent to the reliability of the replaced 
component. | 


4. ases Fourteen Through Twenty-one and Thirty Through 


ae Reliability Block Diagran 


01 02 eee —)| KK . 


sapmwanti ee 


b. Test Parameters 


14 20 12=1,2,.-.2,19 
15, 18,30 29, 2152566 = 22 
16,17,31 50° 1=1, 2,226, 25 
17,20,32 VO0) 2-127. --72> 

21,33 9200 2=1,2,22.;,25 
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and Ri. 

BG 2S CS ee ee eee 

.995 i=1,2,...,14 

14 .79239 
.850 i=15 
15,16,17 .88222 .995 i=1,2,.--,25 

bot isceraay 97530 .999 581-1. 22 eee > 
30, 31, 32, 33 


c. Discussion 


These cases correspond to several cases fron 
Ref. 1 with the exception of cases 21 and 33 of the present 
study. These were added when it was noted that a large 
number of runs with zero failures were being observed with 
as many as 100 tests on each component. Cases 30 through 33 
are identical with cases 18 through 21. They are identified 
as separate cases, since a slightly different procedure, as 
described in section Dh vane was followed in their 


Simulation. 
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a. Reliability Block Diagram 





In logical series with 
@ —— @€6606 
cI) PALS 


De Test Parameters 


Cases _Ni 
Jia, G58) 20 d= iWpee giecceet, OU 
J, fe Ai PLS. is), 27 een 


24,28 a0 1=1,2,.<..,50 
25429 100 = 1 een 7 OU 
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and Ri. 
_cases__ __Rs Ri__ 
999 Beg 2 gies ope 
22 - 886 1=27, 26398. 732 
(See : 
through -900 1=33, 34 
below) ; 
29 oe i=35;36) 0 
.990 i=42,43,44 


j | 3j=1-44 
22 £9. 25 57306 (995) 
1=45,46,...,60 


j} {j=1-44 
Z6°t929" 53293 (.990f 
1=45,46,...,60 


‘ 
c. Discussion 


The second and third subassembly reliability 
diagrams above were drawn from the Lockheed Reliability 
Evaluation Plan for the Trident Missile [Ref. 3]. 

In the second dlagram, component yy and both 
components 41 must operate successfully for system success. 
An additional feature of this design is the capability of 
obtaining successful functioning of component 44 by 
following a logical path through component 39 and continuing 
in a reverse direction to reach component 44 from the 
Opposite side of the diagram, if necessary. This capability 
is illustrated with double arrows to indicate that the 
logical success path may be traced in either direction for 
that portion of the reliability diagram. Note also that 
identically numbered components are, in fact, separate 
components but identical in operation. Therefore, component 
test results for a particular component type are assumed to 
be equally applicable to all components of that type, 


regardless of the specific application. The celiability 
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equation for this portion of the diagram, as adapted from 
reference 3, is as follows: 


: 
R = ~ we - 
en Teo) 15 
+ - = a oe 
(1-T )L LL ta [1 (ane ac 1 
+ (1-M =, (ae 2 
( ,) [uM Mot TLL (1 (1 Al MI 5) J 


Ge i al wa ee 
2 23123 


a ey Meee Tent 
3 gies (3.1) 

where fT = fh. Rey k R M =R 

1 35 36 37 38 1 38 

T = RIR Aon 

2 33 39 2 43 

T =R R R ee 

3 39 40 41 3 44 

OS 2 ee ee: M o=R 

1 35 36 42 43 4 39 

L =R R L =T 

2 43 39 3 3 


The third subassembly diagram illustrates 
another type of reliability problem in that the subassembly 
reliability is defined in Ref. 3 as follows: 


60 
R, 


a} 
R = 1-45 1 
SS —_——_—_—_—_—_ 
16 


Although these diagrams represent current 
systems, the reliability values chosen bear no intentional 
relation to actual values other than that acquired when 
choosing them on a criteria of reasonableness. Therefore 


the values used are not classified. 
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A. SIMULATION RESULTS | 


The simulation output is listed in detail in Appendix D 
for each run. Each case was Simulated three times with 
different random number genetator seed values to insure 
against the occurrance of non-representative singularities 
in the observed data. Each sinulation is distinguished by a 
letter suffix, a, b, or c, to the case number in Appendix D. 
The starting seed used each time was the ending seed value 
from the previous run. This insured that each run would be 
independent [Ref. 5]. 


The demonstrated accuracy of the estimation procedure 
can be measured in terms of the difference between the 
100(1-a) percentile of the simulation results, R*°, and the 
true system reliability, Rs. This difference, labeled D in 


the output tables, is defined as follows: 
D = R*0 - Rs (4.1) 


As mentioned in Section III.A, the absolute value of D 
should be small and reflect a conservative error. This 
desired conservativism is satisfied so long as the sign of D 
1s negative. Otherwise the lower confideace Lime 
estimation procedure would yield overly-optomistic estimates 
and could not be a valid vehicle for the description of 
system reliability. The one instance where this condition 
was not satisfied occurred in Case 13c. However, the value 


of D was extremely small, represented less than one-half of 
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one percent error, and differed from the conservative 


results of the other runs by less than one percent. 


It should also be noted that the distributions of the 
estimates Ti, S, and [ are discrete in nature and the values 
are determined by the number and arrangement of components 
and the number of component tests. Estimates based upon few 
failures wilt exhibit the most highly discrete sample 
distribution scheme. The effect of this discreteness will 
generally be to increase the observed error magnitude unless 


some form of continuity correction can be developed. 


B. ANALYSIS OF RESULTS 


The simulation output for Cases One through Twelve 
was expanded to include the complete ordered arrays of 
estimated confidence limit values in order to establish the 
hature of the sample. Some properties were evident from 
inspection. The samples were unimodal and discrete, as 
expected. Discreteness was most pronounced in the higher 
valued estimates. The sample distribution appeared nearly 
symmetric and this supposition was checked by comparing the 
sample mean and median values and also by plotting 
complementary guantiles. The first test showed very close 
agreement throughout. The second test indicated that only 
Minor left skewness exists in most cases. Skewness seemed 
more pronounced for higher values of system reliability, as 
Might be expected might be suspected, since the distribution 


is bounded by an upper estimate value of 1.0. 


The shape of the distribution was further described 
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by eXamining the ratio of the interquartile range divided by 
the interdecile range and comparing it with the same ratio 
from the Normal distribution which is about 0.526. The 
observed values were generally on the order of 0.50 which is 
in good agreement considering the discrete nature of the 
Sample distribution. Systems designed with high reliability 
coupled with insufficient testing, such as Cases 18 and 19, 
exhibited great variations in the ratio, from 0.2 to 1.0, 
due to the sparcity of different sample values occuring in 
the pronouncedly discrete sample distribution. . 


Another useful measure of shape is the sample 
Standard deviation. Tet is particularly helpful in 
quantifying the spread of the data in terms of the units of 
measure. The preceeding ratio, on the other hand, was 
independent of the anits. The sample standard deviation, 
however, gives no indication of skewness nor the 
discreteness of the underlying distribution. The standard 
deviation is most useful when these higher order effects are 


small. 


The ability to predict the standard deviation from 
the test plan ang system design parameters would provide an 
additional measure of the system reliability. This concept 
evolves from a consideration of the 100(1-a) percent lower 
confidence limit. Of itself, it tells us only that there is 
a (1-a) probability that the true system reliability is 
greater than a particular value. The standard deviation of 
the estimate of this confidence limit can provide a feel for 
how much the true system reliability might vary from the 
estimate. For example, given an eighty percent Lower 
confidence limit of 0.78 and a predicted standard deviation 
of the estimate of 0.005, we can feel fairly certain that 
the true system reliability does not exceed 0.82. However, 
had the standard deviation been 0.01 or 0.02, there would be 


increasing uncertainty about the range of likely values of 
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true reliability. Therefore, the sample standard deviation 
has been included in tke regression section later in this 
chapter in an effort to not only predict procedure accuracy, 
but also estimate spread. 


Previous tests of the original Log-Gamma procedure 
have indicated that the quantity 


k 
TT = £ (Ni) (Qi) (4.2) 
1=1 


could be used as an indicator of relative accuracy of the 
procedure, where Ni is the number of mission tests performed 
upon the i-th component and Qi is the design or expected 
unreliability goal for the i-th component [Ref. 1]. The 
quantity determined in this manner was the total amount of 
testing relative to the component unreliabilities, or, 
approximately, the expected number of test failures summed 


over all components and tests. 


A similiar measure was sought for the revised 
procedure examined in this paper. However, a simple 
expression, such as equation (4.2), could not be directly 
applied to the mixed series-parallel systen. Rig the 
equation were used, it could lead to extremely large values 
of TT, since the parallel components would tend to dominate 
the sum. This is reasonable to expect, Since the components 
connected in parallel, taken individually, would tend to 


have greater unreliability than the series components. 
The first revised equation proposed for [IT can be 


used wherever all components within each parallel subsystem 


are given identical numbers of mission tests. 
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os K1+K2 
TT = .% (N21) (Q1) + | 2% (Ni') (Qi") (4. 3) 
1=1 1=K1+1 


where K1 is the number of series components in the systen 

K2 1s the number of series-parallel subassemblies 
connected in logical series in the system 

Ni, Q1 are defined as above. 

Ni' is the common number of testS given each component 
in the i-th subassembly. 

Qi' is the unreliability of the i-th subassembly 
computed from its component unreliability goals using 


standard series-parallel reliability computation techniques. 


Equation (4.3), in effect, reduces each subassembly 
to an equivalent ‘pseudo-component! connected in series in 
the system. The quantity TT 1S now approximately equal to 
the expected number of system-affecting failures summed over 
all components, subassemblies, and tests. However, the 
drawback of this equation is the necessity of testing all 
componerts within a subassembly an identical number of 
times. It would seem unnecessarily restrictive to conduct 
the same number of tests on a medium reliability component 
and on a high reliability component just to satisfy the 


equation. 


Therefore an alternate formulation for the term 
(Nit) (Qi') was sought which would provide a meaningful 
measure, and yet would allow unequal amounts of testing 
Within subassemblies. The following ad hoc formulation 1s 


proposed: 


Each wholly series-connected branch within a 
subsystem will first be reduced to an equivalent single 
component by the following formula 

£ (Ni) (1-Ri) 
1€8 
Nie eee (4.4) 
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where Rb is the classically determined branch reliability 


goal Rb = Hee for series-connected components. 
é 


i! 

Ri is the reliability goal of the i-th component. 

B is the set of all components in the branch. 

Nb represents an "equivalent" number of branch tests 


(need not be integer). 


Tke series-connected branch is replaced in the 
remaining computations by a single equivalent component with 
reliability goal Ri = Rb and number of mission tests Ni = 
Nb. 


After all wholly series-connected branches have been 
reduced in this manner, each wholly parallel-connected 
branch in the revised subassembly is _ reduced to an 
equivalent ccmponent in the following manner: 

Compute the eguivalent reliability gval 

oe = 1 {t= R2) 
HL ieie 
in the usual manner. 

The number of possible combinations of individual 
test results for the branch components is ee Ni, Whicen “is 

1.¢ 


set equal to the, same number of possible combinations 


obtained if each component had been tested Nb times. Thus 
the equivalent number of mission tests, Nb, 1s computed as 


the geometric mean of the component tests 


The above procedure is repeated until the entire 


subassembly is reduced to a single equivalent component, i', 
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with its equivalent number of mission trials, Nit, and 
equivalent unreliability goal, Qi' = 1-Ri'. TT may then be 


computed as before: 


KT ; K1+K 
TT = x (Ni) (Qi) + . = 
1=1 1 


Z 
Nit) (Qi' 4. 
aagiiap > eee (4.3) 


3. Accuracy Prediction 


| Appendix E contains the equations and methodology 
used to attempt to relate the accuracy meaSure, D, and the 
estimate Standard deviation to the quantity MIT. The 
principal conclusion to be drawn from the results is that 
accuracy is a predictable quantity only with respect to 
particular system configurations for which models have been 
generated and tested as in this paper. Accuracy seems an 
unstable variable from configuration to configuration, 
although it appears to be fairly well behaved within any one 


configuration. 


With respect to the estimate standard deviation, the 
value appears to be related more to the number of component 
tests than to the expected number of system affecting 
failures. Reduction in the magnitude of the standard 
deviation by about 0.01 appears to require alomst double the 
number of component tests. However, the magnitudes are 
generally less than 0.07 for component test sample sizes of 
20 or more. The standard deviation values also appear to be 


fairly insensitive to changes in system configuration. 


e 


4. Comparison with Earlier Results. 


Cases 13 through 20 were taken from Ref. 1 in order 


to provide a basis for checking relative accuracy when 
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extending the Log-gamma procedure beyond simple series 
systems. Unfortunately, an apparent shortcoming of the 
Original simulation makes the 1968 data suspect. 


The original results tended to be too optimistic for 


those cases, in particular, where the number of component 


tests was moderately low and the true component 
reliabilities were high. Significantly high estimates at 
the 100(1-a) percentile were observed in the cases 


corresponding to Cases 13, 15, 18, 19, and 20 of the present 
study. Although, on this basis, the comparison is very 
favorable to the present procedure, it is thought that the 
original simulation results are in error with respect to the 
procedure. Reference 1 does not specifically identify the 
random number generator used, however some uniform randon 
Variate generators do not perform well for very small or 
very large numbers near the boundaries, such as would be 
encountered in the simulation procedure used in the original 
study. The present simulation binomial random variate 
generator was tested prior to use to insure proper 


performance throughout the range of simulation values used. 


Of the remaining cases (14, 16, and 17) the original 
results were much closer to the true system reliability in 
the first two cases and comparable in the last case. 
However, these results cannot be considered meaningful in 
light of the suspected problems with the random number 


generator. 


In addition, many instances of cases found in Ref. 1 
had prima-facia unreasonable results for _ the 100 (1-4) 
percentile values, in that they were considerably higher 
than the upper bound imposed by the zero-failure, binomial 


system test treatment discussed in Appendix C. 


Another difference between the original study and 
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the present one is the use of an arbitrary continuity 
correction in the earlier procedure. This could also have 
been a contributor to the excess optimism in the reported 


Simulation results. 


In light of the foregoing paragraphs, no comparison 
with the results of this study was deemed worthwhile. 


C. CONCLUSIONS 


The primary conclusion to be drawn from this study is 
that the Log-gamma lower confidence level procedure for 
series-parallel systems can be accurate. How accurate it 
Will be in any specific application is a function of the 
magnitude of the component testing program, the individual 
component reliabilities, and the complexity of the systen. 
In addition, of course, the validity of the assumptions 
concerning component interaction and mission environment 
will also tear directly upon the accuracy of any procedure 
which purports to estimate system mission reliability fron 
component test results. The effects of these assumptions, 
however will be controlled by the proper design of the 
component test procedures and are not addressed in this 


study. 


For the cases considered the Log-gamma procedure tends 
to be conservative, which is necessary i1f one takes the 
position that pleasant surprises with better than expected 
performance cost less than unpleasant surprises in the form 
of degraded demonstrated reliability. Of course, too much 
underestimation of system reliability could drive up the 
development costs inan unnecessary search for a much more 


reliable design. 
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The accuracy indicator TT developed in Section IV.B.2 
can be used aS a rough gauge of expected procedure accuracy. 
The following scheme is suggested for minimum values of TT 


for fairly good expected accuracy: 


Approximate 


Order of a = 0.20 a = 0.10 a = 9.05 
Accuracy 
Oe0Z Bo4 1 2 fe! 19.2 
O20 11.7 23:20 3236 


However, Since procedure accuracy’ is so déemonstrably 
sensitive to variation in the system configuration, the best 
approach prior to use of the Log-gamma procedure is to 
perform a simulation as described in Section III.A for the 
particular system design to be exercised. Such a simulation 
could be used to evaluate many different combinations of 
component test plans and also support the claimed accuracy 
of the lower confidence limit derived from the adopted test 
plan results. The investment in such a simulation effort 
should not be excessive from the standpoint of computer 
time, since the most complex cases examined in this. study 
required less than five minutes of Central Processor Unit 
(CPU) time from start to end. Without the support of such a 
simulation specific to the system, the accuracy of the 


procedure can be predicted only very approximately. 


For extremely reliable systems, for which few failures 
are expected with large amounts of testing, the binomial 
lower confidence limit procedure developed in Appendix C 
might provide the desired magnitude of the lower confidence 
limit without the extra testing required to achieve the 
desired accuracy of the Log-gamma procedure. In fact, for 
cases of one failure or less, the binomial procedure is 
probably preferable on the basis of both theoretical fTigor 


and ease of computation. 
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Finaliy, the matter of a continuity correction should be 
investigated. An appropriately determined continuity 
correction procedure could conceivably reduce the component 
testing requirements for the same expected procedure 


accuracy. 
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APPENDIX A 


DERIVATION OF UNBIASED ESTIMATE FOR Ti 


For 
Ti = Q1 + Qi2/2 


an unbiased estimator is desired, based upon the comfonent 
failure data. Let Fi be the number of failures observed in 
Ni mission tests on the i-th component. The expected value 
of Fi is NiQi and an unbiased estimator, Oi, for Qi is 
Fi/Ni, where Fi is binomially distributed with parameters Qi 
and Ni; Qi = 1-Ri; and Ri is the “true reliability of the 


i-th component. 
An estimator, Ti, for Ti will be chosen of the forn 
Ti = Aif[Gi] + Bitdi2]/2 (A. 1) 


and the constants Ai and Bi chosen so as to make the 
estimator unbiased, that is the expected value of Ti is 


equal to Ti, 


E[ Ti] = Ti = Qi + Qi272 (ee) 


AGEL Qi] + (Bi/2) E(Qi2] 


(AL/Ni)E[ Fi] + (B/2Ni?) E[ Fi2] 


(AL/Ni) [ NiQi ] 
+ (Bi/2Ni2)[ NiQi-NiQi2+Ni2Qi2] 


AiQi + BiQi/2Ni - BiQi2/2Ni + BiQi2/2 


= [Ai + Bi/s2NiJOi + [Bi/2 - Bi/2Ni]Qi2 (A.3) 
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Eguating equation (A.3) term by term with equation (A. 2) 
yields the following two equations 


Ai + Bi/f2Ni = 1 
and Bi - Bi/Ni = 1 


which reduce to expressions for the unbiased estimator 


constants: 


Ai = (2Ni-3)/(2Ni-2) (A.4) 


and Bi Ni/ (Ni-1) (R15) 


Se, 





APPENDIX B 


APPROXIMATION OF Var(Ti] BY Ti/Ni 


A. DERIVATION OF Var[Ti] 


The variance of Ti is derived as follows: 


From appendix A, 


Ti = AiQi + (BiQi2) /2 (B. 1) 
thus, Pi2 = Ai2Qi2 + AiBiQi3 + (Bi2Qi4) /4 (B.2) 
Var[Ti] = E[Ti2] - E2(Ti] (B. 3) 


EYTi2] - Ti2 


(Ai2/Ni2) ELPi2] + (ALiBi/Ni3) E( Piz] 
+ (Bi2/4Ni*) EL Fit ] 
- (Qi2+Qi3+ (Qi*/4) ] (B.4) 


Using the moment generating functions for the binomially 


distributed variable Fi, with parameters Qi and Ni, yields 


E{ Fi] = NigQi (3.5) 
E[Fi2] = NiQi + Nigi2(Ni-1) (B.6) 
E[ Fi3] = NiQi + NiQi2(Ni-1)[ 3+Qi(Ni-2) ] (B.7) 
E{ Fi*] = NiQi* (Ni-1) (Ni-2) (Ni-3) + 7NiQi2 (Ni-1) 


+ 6NiQi3(Ni-1) (Ni-2) + NiQi (B.3) 
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Substituting the-moment equations (B.5) through  (B.8) 
into equation (B.4) and simplifying the resulting expression 
yields the following equation for the variance of Ti: 


UNi2-3Ni+1 3Ni-4 





(ack =) Oy ee ie 
tT WNi (Ni-1) 2 2Ni(Ni-1) 
ae 2Ni-3 a 
<= ak SS RR RR Bd ® 
Ni-1 2Ni(Ni-1) 


or, in terms of Ai, Bi, Ni, and Qi: 


Bi2+2Ni2Bi(Ai+Bi) |  2Ai+1 
———— ————————— Oi + 


var[ Ti} = WNi3 2Ni 





; Al 
Bae Ol Be a (B. 10) 


To test the approximation of Var[ Ti] by Ti/Ni, equation 
(B.9) was sOlved with representative valures of Qi and Ni 
and compared with E[ Tij/Ni. The percent error of the 
approximation was computed for each value and iS given in 
table B-1. As expected, increasing Ni or decreasing Qi 


improves the accuracy of the approximation. 


By way of comparison, table B-2 shows the relative 
accuracy of this same approximation when Ti is defined as 
the first three, vice two, terms of the logarithmic series 
expansion of S [Eq. (2.3) ]. In this case the unbiased 


estimator for Ti will be 


Ti = Ai'OQi + Bi'Qi2s2 + Ci'Qi373 (B. 11) 
where ee 6 (Ni- 1) (Ni-2) -3 (Ni-4) -2 
1 Se 
6 (Ni-1) (Ni-2) 

Ni (Ni-4) 

B1? = eee «ATES EO Ge” 
(Ni-1) (Ni-2) 

Ni2 

Cie 


(Ni-1) (Ni-2) 
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Qi Ni = 10 Ni = 50 Ni = 100 
0.001 -5.08% -1.10% -0.60% 
0.003 = Sez Ove eles ot -0.79% 
0.006 52 2% -1.58% =1.09% 
0.01 -5.87% -1.96% —-1.47% 
0.03 =-7.50% -3.73% =3.26% 
0.06 -9.64% -6.07% =5. 62% 
0.10 =) 7 0g =8-°69% —-8.23% 
0.20 = 1568 7 -12.9% = | Ae.) 
Cra0 =i) 50h -14.4% -14.1% 
0.40 -15.8% -13.4% -13.1% 
0.50 =12.0% -9.67% -9.38% 
0.60 -4.77% =2.4 0m = 22a 
0.70 +7.70% +10.3% +10.6% 

Table B-1. Error Percentage of approximation 


for Var[Ti] Using Two-term Form of Ti. 


Qi Ni = 10 Ni = 50 Ni = 100 
0.001 -0.06% 19) (US G4 -0.05% 
0.003 -0.17% -0.15% -0.15% 
0.006 -0.33% -0.31% =0.30% 

0.01 =10)- Siler -0.51% -0.51% 

0.03 -1.68% -1.54% 1) 5) Sih 

0.06 -3.36% =a) aE) -~3.06% 

0.10 =52 57% =5.11% -5.06% 
Table B-2. .Error Percentage of approximation 


for Var[ Ti} Using Three-term Form of T1. 


Due to time constraints and the general acceptability of 
the use of the 


definition of Ti was left for future study. 


the values noted in table B-1, more complex 


However, figure 
B-1 plots the accuracy as a function of Qi, Ni, and form of 


iho 
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Table B-2 


Ni=100 


Nizi0 


-8 
“ 
| Table B-1 
Ni=100 
| 
464 
Ni=10 
-18 


Figure B-1. PERCENTAGE ERROR OF APPROXIMATION FOR VAR(Ti] 
VS. COMPONENT UNRELIABILITY. 
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APPENDIX C 


SPECIAL CONSIDERATIONS WHEN S EQUALS ZERO 


When all components have completed the course of mission 
tests and no failures have been observed along some 
reliability path through the system, the estimator S$ will 
equal zero. This, in turn, will result in the log-gamma 
lower confidence limit estimate being equal to one unless 
the procedure is modified to include some "virtual" or 
"pseudo" test failure value for the computations when this 
occurs. The alternative is to seek some other lower 
confidence limit procedure which applies with zero failures. 


Such an alternative is also suggested below. 


For Simplicity, assume all series components and 
Subassemblies have been subjected to an equal number of 
mission trials, N, without failure. This may be thought of 
as equivalent to conducting N mission trials on the system 
Without failure, subject to the usual assumptions concerning 
test environment and component interaction effects. Wnen 
unequal numbers of component trials are involved, the 
conservative course of action 1s to choose N equal to the 


Smallest of the component trial values. 


Now the number of system mission trial successes, W, can 
be related to system mission reliability, Rs, by the 


binomial distribution formula 


Nog j N- 3 

>. ( : (RS jie (7 =" RS) = Prob(# successes 2 W) (C.1) 
J 

J=W 
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where N = number of mission trials 


The 100(1-a)% Lower Confidence Limit Estimate for system 
reliability would then be the solution for R* in the 
following formula: 


N 
N j N-j 
>. ( . (RY) (1 - Re) = (C.2) 
: J 
j=W 


which, when W = N, reduces to 


N 
(R*¥*) = a or R¥ = ( a ) 


This result may then be substituted into the Log-gamma 
procedure formula for R*€o) and solved for the number of 
equivalent component failures which would yield the same 
estimate of system reliability. 


' -[2r] $ 1/N 
R*Ca) = exp|—-—-———_—- = ( a ) (C. 3) 


FR ss)’ 
eed 
1=1 


Uo 


i=1 Ni 


where 


K . x 
S=aoer ) r= max | 1.0, 


pans 
ni AN 


fisanda: = max[1, (Ni) (Ti) }, Since only 


which reduce to §S 
one component or subassembly will make a non-zero 


contribution to the sums. 


Now, if © = 1.0, then (Ni) (Ti) $< 1.0 and Ti < 1/Ni. 
Also recall that 





Ti = (Ai) (Qi) + (Bi/2) (Qi2) (2.5) 
where 
2Ni - 3 . Ni . Pa 
— aa ena Bi = ae eo ee 
2(Ni-1) Ni- 1 Ni 
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Or, equivalently, 
(Bi/2Ni2) (Fi2) + (Ai/Ni) (Fi) - Ti = 0 (enh) 
Substituting for Ai, Bi and the earlier inequality for Ti, 
Ni 2Ni-3 1 
es eco a 
which reduces to 
Fi2 + (2Ni+3) Fi - 2(Ni-1) < 0 
which, in turn, can be factored as 
(Fi - 1){Fi + 2(Ni-1)] < 0 (C.5) 


The only positive values for Fi which can satisfy this last 
equation are Fi less than or equal to one. This means that 
for any size Ni, the value of [2r] Will be two. We can now 
solve the reliability estimate equation for Fi*, the number 
of equivalent failures for the Log-gamma method. 


-(2r] s 1/N | 
53 (ee ee) oa) (C.6) 


\X Pet, 1-0 


2 
Ze Cae Ai (Fi*) Bi (Fix) 2 
ne ne ee (C.7) 
Qn N 2Ne 
which reduces to 


2 
Fix2 + (2N-3) Fix + wy an er] X3,1-9] = 0 (C.8) 


This quadratic may be solved for Fi*¥ as a function of N 
and a. The results are listed in table C-1. From the 
table, choosing Fi* at the N = 10 level will be conservative 
for all N greater than 10, yet will yield relatively 
accurate results for all larger N due to the slow rate of 


change of Fi* with respect to N. 
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N a=0.2 

3 023865 

10 0.35721 

20 Jee 652 

100 0.3603 

1000 023593 
Lapie C= i. 


a=Q.1 
0.2670 
0.2531 
0.2475 
0.2435 
0.2427 
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Chain | be) 
Oa) eas 
0.1610 
0.1570 
0.1542 
0.1536 


Solution for Fi* with 


Various N and a Values. 





APPENDIX D 


TABULATED SIMULATION RESULTS 


The following pages contain two tables listing the 
principal simulation output data. The tables are presented 
concurrently for each case, one case per page. The cases 
are listed in alpha-numeric order. The following list of 


terms applies: 


Case: The case number as explained in Section III.B. The 
letter suffix distinguishes between different runs of 
the same case using different seeds for the binomial 


random variate generating function. 


KK: The total number of components in the system. 

oud yee The accuracy indicator as discussed in seciton IV.B. 

eles The modified accuracy indicator described in Appendix 
lag 

RS: True system reliability. 


CL. Confidence Level, CL = 100(1-2). 


R*°:; The 100(1-a) percentile of the simulation estinates of 
the 100(1-a)% lower confidence limit for system 


reliability. 


Des The primary accuracy measure. As discussed in Section 
IV.A, D = R*9 - Rs. 


Mean: The sample mean of the estimates. 


S.D.: The sample standard deviation of the estimates. 
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Null Runs: The number of runs which occured during the 
Simulation for which § equalled zero. Refer to 
sections I1f.C and III.A and Appendix C for further 


elaboration. 


49 





S.D. 


Mean 


Cx R*0O 


TM RS 


gf Ak 


KK 


Case 


0.0668 
0.0608 
0.0586 


0.7728 
0.6896 
0.5897 


=e 0950 
-0. 1304 
—Oerez 9 


0.8206 
0.7452 
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Additional Simulation Output (continued) 
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Results (continued). 


Simulation 


Table D-1. 
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Output (continued) 


Additional Simulation 


Table D-2. 
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Results (continued). 


Simulation 


Table D-1. 
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Additional Simulation Output (continued) 


Table D-2. 
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Results (continued). 


Simulation 


Table D-1. 
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Additional Simulation Output (continued) 


Table D-2. 
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Simulation Results (cont 


Table D-1. 


Maximum 


90 % 


h 


NGS Values 


it Estima 
Median 


ys 


¢ 


Lower Se eee ee 


% 


10 


inimun 


M 


CL 


RS 
0.88222 


Case 


MOC 
Ooo 
an Nolo) 
zero 
orm 


CrMmn 
nwt 
mom 
Ors 
CO FO 


COM N 
LON 
Hem 
NN 
comvw 


MONO 
NAAN 
ONW 
DAN 
M™ Wr 


Now) 
mON 
O =O 
com 
mow) 


moOWr 
Oor 
wzrow 
nw 
WoOsr 


wow 
oa 
mmo 
mA 
nin = 


oOow 
Ondo 


40 


15a 


MOw 
O00 
Owo 
zrmo 
comm 


orn 
Fe pn) Dim 
mom 
sek a 2 
comw 


COmN 
Yohed 
Mom 
Nos 
COmw 


LlONM 
NANO 
OoONWw 
NAN 
Moro 


HOS 
™~Ooo 
Nok oa 
MOC 
POW 


mown 
Com 
tow 
awry 
Woz 


mX~umw 
SON 
N&O 
INOW) 
lw => 


oow 
Ono 


53 


0.818222 


15b 


selanloe) 
o200 
Owo 
zero 
comm 


Orn 
ANAS 
mom 
OTs 
Como 


COM N 
mom 
Mom 
Nwzw=a 
Coro 


muy 
As 
omnrm 
Hom 
(C5 


HOS 
moo 
Oar 
Tele ola) 
M™WOw 


e® 6 ® 


mon 
Coo~ 
wow 
NwzrWh 
OOs 


Wew 
NO 
Ww) =P CO 
m™NWY 
WW = 


Cow 
ODN 


0.88222 45 


15c 


d) 


1nue 


Additional Simulation Output (cont 


Table D-2. 
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Results (continued). 


Simulation 


Table D-1. 
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Additional Simulation Output (continued) 
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Results (cont 
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Simulation 


Table D-1. 
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Additional Simulation Output (continued) 
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Results (continued). 


Simulation 


Table D-1. 
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Additional Simulation Output (continued) 
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Results (continued). 
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Table D-1. 
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Additional Simulation Output (continued) 
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Results (continued). 


Simulation 


Table D-1. 
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Additional Simulation Output (continued) 
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Simulation Results (cont 
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Additional Simulation OJutput (cont 
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S.D. 


Mean 


CL R*° 


Rs 


TT TM 


KK 


Case 
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APPENDIX E 


REGRESSION OF OBSERVED ACCURACY 


Examination of the tabulated data in Appendix D suggests 
that a linear relationship is not directly applicable to 
regression of the accuracy measure, d, on any of the other 
variables. The terms TT, developed in section IV.B.2, and 
KK, the number of components, appear to be the most likely 
Candidate independent variables for the model. Plots of 
these terms versus D suggest that an exponential decreasing 
or inverse power curve could be used to model procedure 


accuracy on TT, i.e. 


D aeexp (beTT) (Ere 1} 


b ; 
D = aeTT (E.2) 


where a and b are appropriate constants from the underlying 
response function. Each of these models can be easily 
transformed into a linear nodel by taking the natural 
logarithm and redefining variables and coefficients where 


convenient. 


The plots indicate, however, that the systen 
configuration has a strong effect. Therefore, curve fitting 
will be initially confined to similar configurations in the 
following groups: Cases 01 to 12, Cases 14 to 17, and Cases 
22 to 29. Cases 18 to 21 will be considered only with 
reservations due to the artificial bias introduced by the 


particular procedure used which ignored failureless fruns. 
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Cases 30 to 33 will not be 


fitted since the procedure 


employed caused the sample to be drawn from two quite unlike 


distributions and the plots 
discontinuity between the results 
Section II.C and Appendix C). 
are good, a composite fit will be 
17 and 22 to 29. This fit would 


demonstrated an apparent 
of the two methods’ (see 
Finally, if the group fits 
attempted for Cases 01 to 
not be expected to be good 


due to the observed inter-group plot variation. 


\ 
A. EXPONENTIAL CURVE FIT 


Consider the linearized exponential model 


D' = A + beTT 


where D* = in(-D) and A = In(-a). 


(E.3) 


From the Method of Least 


Squares, expressions for A and b can be derived directly. 


b= 
L tle =e |e 
1=1 1 nti=1 
Ten | De n 
BS e jb BI > =| eee 
néi=1 14 néij=1 1 


n 1 n n 
rgT pt - -[ 2 ao ||| D | 
1=1 12uul n*i=1 123%1=T71 1 


and the coefficient of determination [Ref. 6] is 
n Treon n 2 
ypirp!- —{ Cee: TT | 
1=1 121 n4i=1 1441=1 1 
n 1p on 2 n Tron 2 
rs pp2 - -[ 5 rr | oy 0s =|(p Dt | 
i=1 i nti=1 1 1=1 1 nti=1 1 


The results of the exponential curve fit were as 


follows: 
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Cases ie een Ween 
01-12 720 -~0.040 -0.065 0.690 
~10 -0.094 -~0.076 Olea 
205 -0.073 -0.048 0.738 
14-17 - 20 — Ort 1d -0.290 0.942 
~10 =O Ot ~0.282 0.938 
-05 -0.480 -0.260 0.988 
22 22.0 -0.049 ~0. 156 0.896 
~10 -0.153 -0.170 0.899 
“0D -0.346 -0.216 0.917 
B. INVERSE POWER CURVE FIT 
The power curve may be linearized to the forn 
D' = A + bettT! (E. 3) 
where A and D' are defined as before and TT' = ln(TT). The 


coefficients, A and b, and the coefficient of determination 


may be found as described in the preceding section with the 


substitution of TT! 


for IT where occuring. 


The results of the power curve fit were as follows: 


CaseS _&_ en, - o == See bee 

01-12 aoe -0. 130 -0. S68 0.844 

- 10 -0.368 -1.016 0.883 

200 -0.780 -1.124 0.893 

14-17 720 -0.664 = ANNES 0.986 

-10 Silo Sis) 5) -2.016 0.972 

205 -2.110 -1. 828 0.992 

227-29 SPAN, -0.159 = i) co ells) 0.989 

~10 -~0.543 -1.412 0.977 

a05 =e Ot -1.430 0.980 

01-17 we) =O 136 -1.060 0.648 

22-29 -10 -0.459 =) 5 22s: 0.793 

~05 -~0.936 -1.303 0.845 
Comparing these results with those of the exponential 
curve fit indicates that the power curve provides a better 
ake Or the observed simulation data. However, the 
variation in the coefficients between different system 
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configurations implies that, while the fit may be good 
Within like groups, the fit is much more approximate across 
the groups. This is borne out by the composite fit listed 


last in the preceding table. 
C. REGRESSION OF D ON TI AND KK 


For this regression the model chosen was a combined 
power curve 
lo ee 
D = aeTT KK (E45) 
which linearizes to 
D' = A + beTfT' + cekkK' (i <.0) 
where D', A, and TT' are defined as before and KK*' = l1n(KK). 


Solving for the coefficient values by the Method of 


Least Squares yields the following: 

















rsi1eS2 $19eS3 1 S$2¢S3 aro 7 
- s6{{—-—-— - se} - [ - s7}/-— - sa] 
n tL on n 
G rn rrr rr ce NE DS CANE SRA SE PE ASCE SD a TS 
$12 S$1¢eS3 2 
St sulfa gee te 
n 
S1eS2 S10S3 
[ —_— - S6| - c] - 58 | 
n J 
1a) 
$12 
-——— - § 
n 
1 b C = 
a= exp|—S2 - =-S1 - -S3 
in n n 
where n n 
Se, Tr 525 — ee Sor = = Dike 
i=7 2 1=1 1 1=1 2 
n n 
S4o= 5 Tre S5 = 5 KKt2 s6 = 5 [rreep'] 
a=) “2 1=7 12 1=1 5 ee 
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n nh 
ST = 2 Dt eKK! | and Sea [rr!exk'| 
a. = 


From the data for cases 01 through 17 and 22 through 29, 


the following values for a, b, and c were obtained: 


0 = 0.20 a = -0.080 = -1.028 G= 0.129 

a = 0.10 a = -0.386 b = -1.200 c= Q.033 

a = 0.05 a = -1.038 b = -1.279 = -0.043 
An approximate coefficient of determination was 


calculated by defining 


c/b 
TM = TTeKK 


so that 


D= aeTM” 
which is the inverse power curve model and the two variable 
procedure of Section B can be used. This yielded an ré? 
value of 0.626 for gq = 0.2, which shows no improvement of 


fit for the three variable approach. 


Appendix D lists TM values for a = 0.2 for information. 


D. REGRESSION OF STANDARD DEVIATION 


Examination of the sample standard deviation values 
listed in Appendix D also suggests that the power curve form 
would be appropriate to model the standard deviation on TT. 


b 
5-D. = aeTtT 


Proceeding as in Section B, the following values are 


obtained: 
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ee 0..20 a = 0.094 aiid Oar L018 ECo-eO e023 
a = 0.10 a = 0.075 Do=e— OZ tg re = 0.374 
t= 0. 05 a = 0.072 B= =O02215 re = 0.408 


which indicates a poor fit at best. 


However, the data suggests that the sample standard 
deviation may be better predicted as a function of the 


number of component tests, i.e. 


b 
S.D. = aon 


where N represents the "equivalent" number of system tests 


as derived in Section IV.B.2 for use in Equation (4.3). 


The regression yields the following values: 


a = 0.20 a= 0.213 b= 20% 300 re = 0.853 
a = 0.10 a = 0.186 b = -0.365 re = 0.825 
ao = 0.05 a= 0.164 b = -0.339 re = 0.799 


This fit is better and implies that the primary mechanism to 
reduce the sample standard deviation is to increase the 
number of component tests. As the data base is. limited, 
little more than that may be averred at this level of 


analysis. 
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APPENDIX F 


COHNPUTER PROGRAM 


The following pages contain a representative listing of 
the main computer program utilized in the simulation. Three 
proprietary routines were used for binomial random variate 
generation (GGBIN), inverse Chi-Square value determination 
(MDCHI), and ordering of the estimate arrays (VSORTA). 
Reference 4 provides information concerning the contents and 
use of these routines. Equivaient routines could be used 
without penalty to either accyracy or consistence of the 


Simulation results. 


The program was written in the FORTRAN IV language for 
use on the IBM-~360 computer system installed at the Naval 


Postgraduate School. 
Portions of the program must be changed as the 


subassembly configurations are varied in order to tailor the 


computations to the specific system being modeled. 
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COMPUTE SUBASSEMBLY RELIABILITY ESTIMATES 
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